Electronic machine simulating a learning scheme



Nov. 28, 1967 J. H. ANDREAE ET AL 3,355,713

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME Filed July 5. 1965 20 Sheets-Sheet 1 E I 20 3 I JETE] mwrwu- I f'O/PW/IRD 00s M070? LEFT CHEM 4 DEIEC7'0/? WNW 51 5255 SHOW raw 2 5 WMWY m/H/B/r 6 7 B 6' x l H #010 j H010 mam/0w, L m: 55 g EAASf [Mp f :WQ/Tf DETECTOR A uw/r UV/T zo/ve PA N 7752M STEP WARN/N6 MEMORY PA TH firm/AL FOUND Paw/m0 PA N- DOM POW

55L &

FIGS

TOQE

9 msupu 55 mm sropt lnvenlors JOHN H. ANDREAE PETER L, JOYCE Horn Nov. 28, 1967 J. H. ANDREAE ET AL 3,355,713

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME Filed July I). 1963 20 Sheets-Sheet 2 ONE OPEPA T/OA/ HOLD AND 14/9/75 lnvenlurs JOHN H. ANOREAE PETER L. JOYCE Nov. 28, 1967 J. H. ANDREAE ET AL 3,3

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME Filed July 5, 1963 20 Sheets-Sheet I5 RANDOM GENEPA T01? JOHN H. ANDREAS PETER L. JOYCE By H Nov. 28, 1967 .1. H. ANDREAE ET AL 3,355,713

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME Filed July 5, 1963 20 Sheets-Sheet 4 Nov. 28, 1967 J. H. ANDREAE ET AL 3,355,713

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME Filed July 1963 20 Sheets-Sheet 5 FORM! ZfFl' Ai' REV,

Inventors JOHN H. ANDRE 4E NOV. 28, 1967 J, ANDREAE ET AL 3,355,713

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME 20 Sheets-Sheet 7 Filed July :5, 1963 Inventors JOHN M ANDREAE PEI-5R L. J OYCE By l/v x .1 r Attorney Nov. 28, 1967 J. H. ANDREAE ET AL 3,355,713

ELECTRONIC MACHINE SIMULA'I'ING A LEARNING SCHEME 20 SheetsSheet 8 Filed July 5. 1963 Inventors JOHN H. ANDREAE PETER L. J0

Q Adm n JV J. H. ANDREAE ETAL 3,355,713

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME 3. 1963 20 Sheets-Sheet 9 Nov. 28, 1967 Filed July Inventors JOHN H. ANOREAE PETfR L. JOYCE Nov. 28, 1967 J. H. ANDREAE ET AL 3,355,713

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME FLlQd July 3, 1963 20 Sheets-Sheet 10 V HF Invenlors dOHN H. ANOREAG PETER L. JOYCE J. H. ANDREAE ET AL 3,355,713

20 Sheets-Sheet 11 1 a L Eg 8% mi 5 $5385 E\ 5mm 3 s @Q .555 t E E5 7 E 335; Em $95 M Ex? J g mi g1 TT 5% 3 E} 5 $5 Q @535 q mm EESI $328 5 SQ Q96:

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME Nov. 28, 1967 Filed July 3. 1963 Inventors JOHN H. ANOREAE PETER L. JOYCE Nov. 28, 1967 J. H. ANDREAE ET AL 3,355,713

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME 20 Sheets-Sheet 12 Filed July 5. 1963 w t M 5 9% Q 5 mm m i n. 1 1 n E 5 3 Q 8%. 2 A D mt 5 M zmwCE ii P883 {1 SE n 3mm mmw maz mQEE 3mm $95.: A 331% E h mmwmw mwmaw did CE mi G B v f a H E me JO YCE i A tlorney Nov. 28, 1967 .J. H. ANDREAE ET AL 3,355,713

LLECTRONIC MACHINE SIMULATING A LEARNING SCHEME Filed July 5, 1963 20 Sheets-Sheet 15 S74 T5 P4 TIER/V MEMORY Inventors JOHN h. ANOREAE PETER L. JOYCE By y u" Nov. 28, 1967 J. H. ANDREAE ET AL 3,355,713

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME Filed July [5, 1963 20 Sheets-Sheet 14 (UP/P514750 PATTfR/V OUT Egg/i.

lnvenlors JOHN H. ANORISAE PETER L. JOYCE Altorriej Nov. 28, 1967 J. H. ANDREAE ET ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME Filed July 5, 1963 FPUM 20 Sheets-Sheet 15 A Horney Nov. 28, 1967 J. H. ANDREAE ETAL 3,355,713

ELECTRONIC MACHINE SIMULA'IING A LEARNING SCHEME 2O Sheets-Sheet 16 Filed July C, 1963 EQQQ mm wag? 9% g mwl & SEQ

Inventors JOHN H. ANOREA PETER L, JOYCE By r I A Horney Nov. 28, 1967 J. H. ANDREAE ET AL 3,355,713

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME Filed July 3, 1963 20 Sheets-Sheet 17 M p rmw Q) p; R560 DD 551F675 ACTION 4:

PBPFOPMED (9) N0 PEWAPD JOHN H. ANDR'AE PE 7 672 L JO YCE A tlorrivy Nov. 28, 1967 J. H. ANDREAE ET AL 3,355,713

ELECTRONIC MACHINE SINULATING A LEARNING SCHEME fled July 5, 1963 20 Sheets-Sheet 18 Q) Tr/MT N0 PAIN Q W/TH P5 Pg 1111/0 4/ PM W POM y L0; PATH lam/0w mm WE/GHT 42 HOW I/ MAP/(ED NEXT @ I45 DOA/E 6WD 0F cmf [m en/or;

JOHN H. ArvoneAs JOYCE Nov. 28, 1967 .1. H. ANDREAE ET AL 3,355,713

ELECTRONIC MACHINE SIMULATING A LEARNING SCHEME Filed July (5. 1963 20 Sheets-Sheet 19 I nvenlors JOHN H. ANORG'AE PETER L, JOYC By I V 1" V 1 V 

18. AN ELECTRICAL LEARNING MACHINE WHICH COMPRISES INPUT MEANS FOR COLLECTING ELECTRICAL SIGNALS REPRESENTATIVE OF AN ENVIRONMENT IN WHICH THE MACHINE EXISTS OR OF THE RELATION OF THE MACHINE TO THAT ENVIRONMENT, OUTPUT MEANS FOR GENERATING OUTPUT CONDITIONS EACH OF WHICH CAN INFLUENCE THE NATURE OF SAID ENVIRONMENT OR THE RELATION OF THE MACHINE THERETO, FIRST CONTROL MEANS FOR CAUSING THE MACHINE TO SEARCH THE ENVIRONMENT TO ACQUIRE DATA REPRESENTATIVE OF THE NATURE THEREOF OR OF THE RELATION BETWEEN THE MACHINE AND ITS ENVIRONMENT, STORAGE MEANS IN WHICH SUCH DATA MAY BE RETAINED, SAID STORAGE MEANS BEING CAPABLE OF CONTAINING BOTH DATA WORDS REPRESENTING THE NATURE OF SAID ENVIRONMENT OR THE RELATION OF THE MACHINE THERETO AND SIGNALS (HEREINAFTER CALLED REWARD SIGNALS) INDICATING THAT THE OPERATIONS OF OR DUE TO SAID MACHINE''S OUTPUT CONDITIONS ARE SATISFACTORY, AND SECOND CONTROL MEANS FOR CAUSING THE MACHINE TO FOLLOW PATHS OF ACTION INDICATED BY THE DATA IN SAID STORAGE MEANS AS BEING SATISFACTORY, THE MACHINE SWITCHING FROM OPERATION UNDER CONTROL OF SAID FIRST CONTROL MEANS WHEN SUFFICIENT DATA THEREFOR HAS BEEN COLLECTED AND SWITCHING 